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Abstract : The  problem  of  determining  a minimum  energy  control  for  a dynamically 

interconnected  set  of  p single-input  single-output  f i n i te-d imens i ona 1 linear  time- 
varying  dynamical  systems,  for  which  the  outputs  are  constrained  to  assume  prescribed 
values  at  different  points  in  time  is  considered.  it  is  shown  that  the  solution 
(optimal  controller)  is  obtained  by  performing  a linear  operation  on  an  appropriate 
vector-valued  generalized  interpolating  spline. 
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1 . I ntroduct ion 

This  note  presents  a result  developed  in  [ 1 ] - It  shows  how  the  solution  to 
a class  of  minimum  energy  control  problems  with  output  constraints  is  related  to 
interpolation  by  generalized  splines. 

For  complete  generality,  we  consider  a large-scale  system  consisting  of  p 
linear  time-varying  m*1^  order  differential  dynamical  systems  interconnected  by  a 
linear  time-varying  dynamic  compensator  (see  Fig.  1).  For  such  a composite  system, 
we  show  that  the  optimal  solution  (trajectory)  in  the  space  of  outputs  appears 
as  a vector-valued  generalized  L spline,  where  L is  a matrix  of  high  order 
differential  operators,  satisfying  the  output  constraints;  and  we  calculate  the 
cor respond i ng  minimum  energy  control  function  by  applying  the  operator  L to  such 
a spline.  One  of  the  consequences  of  this  study  of  ours  is  the  generalization 
of  splines  arising  from  a single  high  order  differential  operator  X to  splines 
generated  by  a pxn  matrix  L of  mt^1  order  differential  operators,  as  we  have 
indicated  above. 

While  minimum  energy  control  problems  have  been  discussed  at  length  in 
the  control  theory  literature  (see,  for  example,  [2 ] and  [3]),  the  main  point 
of  the  present  note  is  simply  to  establish  the  connection  between  these  control 
theory  results  and  those  in  spline  approximation  (see,  for  example,  [4]  and  [5]) 
which  seemingly  were  developed  in  a separate  context.  It  is  believed  that  such 
a connection  will  be  helpful  toward  providing  insights  and  stimulating  research 
in  both  areas,  as  has  been  the  case  for  example  with  the  connection,  developed 
by  Kimeldorf  and  Wahba  [6]  - [8]  and  Weinert  and  Ksilath  [9]  [ 1 0] , between 
Bayesian  estimation  of  stochastic  processes  and  interpolation  and  smoothing  by 
sp 1 i nes. 

We  do  not  discuss  the  generalization  of  our  results  to  the  Lg  spline 
case  since  it  follows  from  the  considerations  available  in  the 
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literature  [4]  [ 1 1 ] at  the  expense  of  complicating  the  notation. 

Since  [l]  appeared,  Weinert  and  Kailath  have  made  interesting  contributions 
[9],  [12]  to  the  problem  discussed  here  in  that  they  consider  the  case  of  an 
Lg-spline  generated  by  a single  high  order  differential  operator  and  use  a 
reproducing  kernel  Hilbert  space  approach  to  compute  the  minimum  energy  control. 


2.  Problem  Statement 

The  output  vector  y(t)  = col  (y^t),  ...,  yR ( t ))  of  the  composite  continuous- 
time, continuous-state,  linear,  time-varying,  f i n i te-d imens i ona 1 system  under 
consideration  is  assumed  to  satisfy  a vector  differential  equation  of  the  form 
L y (t)  = u ( t ) , 0 < t < a < ® , (1) 

A 

where  u(t)  = col  (uj  (t),  ... , up(t)  ) € rP  , p < n,  and  L is  a p x n 
matrix  with  elements  L.j  , i = 1,  ...,  p,  j=  1 of  the  form 

m 1 

L..  y. (t)  = t (t)  Dy.(t),  D = d/dt,  (2) 

'J  J k=0  IJK  J 

where  m is  a positive  integer  and  £ ; j |<  are  real-valued  functionson  [0,a], 
the  conditions  on  which  are  to  be  stated  in  connection  with  (6). 


We  suppose  that  we  are  given  the  performance  index 

-r- 


I (u)  = 


u (t)  R(t)  u(t)  dt. 


0 


(3) 


where  the  superscript  T denotes  the  transpose, 

R(t)  = MT(t)  M(t) , <4> 

H(t)  is  a pxp  matrix  of  full  rank  over  t € [0,a],  with  elements  in  Cm [0 , a] , 


and  such  that 

L = M(t)  L (5) 

has  the  following  properties:  in  the  ijt^  element  L.j  of  L,  which  is  of  the  form 


L. . 
'J 


P 

= £ 
s=l 


Mis(t) 


"sj 


p m 

= £ Z 

s=l  k=l 


M.  (t)  l (t)  D 


i s 


s j k 


m . 

E lijk  M Dk, 
k=0 


(*> 


^ijk(')  are  real-valued  functions  belonging  to  C^[0,a]  and  ^ f j m ( • ) is 

uniformly  bounded  away  from  zero  on  [0 , a ] - 

Suppose  finally  that  we  are  given  a set  of  values 

Y = {y'e  Rn:  i = 0, 1 n]  , (7) 

as  wel 1 as  a mesh 

A = t0  < t,  < ...  < tN  , (8) 

where  t.,1  d < t„  and  t(  < 

The  problem  under  consideration  may  be  stated  as  follows: 

Prob lem  1 : Find  u*  which  minimizes  the  performance  index  ? (u),  defined  by 

(3),  over  all  u €1.^  (0,a),  under  the  differential  dynamical  constraint  (1) 
and  the  output  constraints 

y(t,)  = y' , i = 0,  1 , . , n.  (9) 

3 . Physical  Interpretation 

Before  we  go  any  further,  it  is  worth  seeking  the  meaning  of  the  equations 

(1)  in  terms  of  an  actual  system.  For  this  purpose,  consider  the  system  of 
p single-input  single-output  systems,  interconnected  as  in  Fig, 1 , described 

by  the  set  of  equations 

r . 

i 

P.  z (t)S  2 a,-  (t)  DJ  z,  (t)  = u;  (t)  + w:(t). 


j=o 


i 1 , • . • , p , 


(10) 


where  r;  are  nonnegative  integers,  a^  are  appropriate  real-valued  functions 


on 


[0,a],  Uj  are  the  controls  whose  energy  (i.e. , square  of  the  L2  (0, a) -norm) 


is  to  be  minimized,  and  Wj  are  inputs  from  an  existing  compensator. 


2 o 

#l.p(0,a)  is  the  linear  space  of  p-tuples  of  elements  of  L(0,a). 


5 


With  the  notation 

P = diag  (Pj,  ...  , P ) (11) 

z = col  (z ] , . . . , zp)  (12) 

w = col  (w | , . . • , Wp) , (13) 

(10)  may  be  rewritten  as 

P z = u + w.  (14) 

Similarly,  the  dynamic  compensator  equations  may  be  written  as 

Qy(t)  = B(t)  z ( t ) (15) 

where  B(t)  is  a time-dependent  n x p real  matrix  of  rank  p, 

Q = diag  (Q, , . . . , Qn)  (16) 

qj 

Qj  Yj(t)  = 2 g j q ( t ) Dq  yj  (t)  , j = 1 , , . . , n,  (]7) 

q=0 


q^.  are  nonnegative  integers,  and  g^(.)  are  appropriate  real-valued  functions 
on  [0,a]. 

The  output  y of  the  compensator  is  connected  to  the  input  of  the  systems 
being  controlled  by  the  interconnection  pxn  matrix  C(t),  that  is, 

w(t)  = C(t)  y(t)  (18) 

Now  (|4)  (|5),  and  (]8)>  together,  are  equivalent  to  (1)  i f we  set 


L = P (BT(t)  B(t))'1  BT(t)Q.  - C(t). 


(19) 


4.  An  Auxiliary  Problem  and  Its  Solution 

Returning  to  our  original  question,  it  turns  out  that  it  pays  to  formulate 
the  prob  lem, which  we  are  cons  i der  i ng,  i n the  y-space  (output  space)  rather  than  in  the 
u-space  (input  space),  for  then  the  results  and  insights  from  the  spline  theory 
can  be  brought  to  bear  upon  the  problem  solution.  This  is  exactly  what  we  now 
proceed  to  do. 
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In  fact,  substituting  (1)  in  (3)  and  using  the  notation  (5),  (3)  may 
be  rewritten  in  the  form 


I (y) 


(L  y (t) ) (L  y(t) ) dt. 


(20) 


Also,  let  H denote  the  linear  space  of  real-valued  functions  f on  [0,a]  such 

that  Dk  'f  is  absolutely  continuous  and  Dkf  € X2(’0,a);  and  denote  by  Hm  the 

n 

linear  space  of  n-tuples  of  functions  in  Hm.  Then  Problem  1 may  be  reformulated 
in  the  output  space  as  follows: 

Problem  2.  Find  y*  which  minimizes  I (y)  defined  by  (20)  over  all  y ( Hm 

n 

under  the  output  constraints 

y(t.)  = y' , i = 0,  1,  ...  , n.  (21) 

The  solution  to  the  above  problem  is  embodied  by  the  following  theorem, 
which  represents  a generalization  to  splines  generated  by  matrix  differential 
operators  of  a well  known  result  [5,  Chap.  6]  for  splines  pertaining  to  scalar 
differential  operators. 

Let  us  define  the  formal  adjoint  of  L as  the  nxp  matrix  L*  whose  ij*" 

element,  i = 1,...,  n,  j = 1,  ...  , p,  is 

L*{j  = (L.,)*,  (22) 

where  (L..)*  is  the  formal  adjoint  of  the  element  L. .of  L,  i.e. 
j i J i 


(L.  .)*(•)  = 2 (-l)k  Dk(^..,(t)  (•)). 


J ' 


k=0 


j ik 


(23) 


Theorem  1 . The  solution  to  Problem  2 always  exists.  It  is  unique  if 
and  only  if 

N(L)  n n = $,  (24) 

where  N(L)  is  the  null  space  of  L,  is  the  set 

n = { f 6 H™  : f(t.)  =0,  t.e  A } , (25) 

and  $ is  the  null  subspace.  Then  the  solution  S(L,A,Y;.)  to  Problem  2 is 
the  unique  function  y*  satisfying  the  following  set  of  equations: 
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(a) 

L*L  y*(t)  = 0, 

t j _J  < t < t . , i = 1,  — , N; 

(26a) 

(b) 

y*(t.)  = y1 , 

i = 0,  1,  ...  , n; 

(26b) 

(O 

yj  € c2m"2, 

j = 1,  ...  , n, 

(26c) 

(d) 

L y*(t)  = o, 

0<t  < tn  and  t.  < t < a. 
— u N — — 

(26  d) 

(Such  a function  y*  is  called  a generalized  L spline  i nterpolat i ng Y over  A). 

Sketch  of  the  Proof.  The  proof  of  the  above  theorem  is  based  on  the  same 
arguments  as  the  ones  for  the  scalar  case  [5,  Chap.  6],  the  extensions  needed 
to  validate  the  results  being  merely  of  a formal  nature.  For  this  reason,  we 
omit  the  details  and  only  sketch  the  steps  involved  in  the  genera  1 ization. Fi - 
rst,one  writes  the  vector  version  of  the  scalar  Lagrange  identity  proved  in 
[13,  p . 86 ] . Then  one  uses  this  vector  Lagrange  identity  to  prove  a vector 
version  of  the  "first  integral  relation"  [5,  p.  195]  which  then  is  used  to 
establish  a vector  version  of  the"minimum  norm  property" [5 , Chap,  6],  By 
this  property,  y*  satisfying  (26a)  through  (26 d)  minimizes  (20)  over  H™, 
under  (21).  The  proof  that  the  uniqueness  of  y*  is  equivalent  to  the  satisfaction 
of  (24)  is  identical  to  that  for  the  scalar  case  [9  ] [ 1 1 ] - 

5 - Return  to  Problem  1 

From  the  preceding  it  is  clear  that  now  only  a small  additional  step 
is  needed  to  bridge  the  gap  between  the  solution  to  Problem  2,  expressed  by 
(26a)  through  (26d),  and  that  to  Problem  1.  The  required  step  consists  of  (1) 
and  (5)  wh i ch,  together,  send  y*  to  u*. 

Formally,  we  summarize  the  above  considerations  as 

Proposition  1.  The  solution  to  Problem  1 i s determi ned  by  the  set  of 
equations  (26a)  through  (26d),  sat i sf i ed  by  y*,  and  the  equation 

u*  = M ' L y*.  (27) 

It  is  immediately  clear  that  if  we  eliminate  this  last  equation  by  substituting 
it  in  (26a)  through  (26d),  the  above  proposition  is  equivalent  to 
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Proposition  2.  The  solution  u*  to  Problem  1 i s determi ned  by  the  set 
of  cond i t i ons  : 


(a)  L*  M u*(t)  = 0,  t._1  < t < t.,  i = 1,  ...  , N;  (28a) 

(b)  Mu*  € { L y : y € H™  , y(t .)  = y ' , i = 0,  . . . , n} ; (28b) 

(c)  u*  € Cm"2,  j - 1,  , p;  (28c) 

(d)  u*  = 0,  0 < t < tQ  and  t < t < a.  (28d) 


In  reference  [l],  the  result  of  the  present  paper  was  formulated  in 
the  form  of  Proposition  1.  Recently,  Weinert  and  Kailath,in  their  work[l2]  with 
Lg  splines  pertaining  to  scalar  operators,  essentially  presented  the  above  result 
in  the  form  of  Proposition  2,  indicating  some  of  the  advantages  of  looking 
at  the  solution  this  way.  Functions  u*  satisfying  a system  such  as  (28) 
belong  to  the  general  class  of  " LM  splines"  introduced  and  discussed  by 
one  of  us  elsewhere  [14].^ 

6 . Examples 


To  illustrate  the  results  presented  above,  we  give  two  simple  examples  for 
which  p — 1,  and  n = 1 and  2 respectively. 


Example  1 

Consider  a system  described  by  the  scalar  differential  equation 
y(t)  = u(t),'  = d/dt ,0  £ t £ a, 
subject  to  the  constraints  (9). 

Then , 


* 

y (t) 


[y(t. ) (t-t . 


) + y(tj_,)(t.-t)] , 


* o 

y (t)  = y ,0  <•  t < tQ, 

yX(t)  = yN,tN  < t < a. 


(29) 


(30a) 

(30b) 

(30c) 


and  the  optimal  control  is  given  by 


Note  that  the  symbol  M in  the  denomination  of  an  LM  spline  stands  for  a differential 
operator  and  not  the  matrix  M appearing  in  the  present  paper. 
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u*(t) ' T7F-7  (y(ti)  - s » < t,.' 

u*(t)  = 0,0  £ t < tQ,t  s t < a. 


. t 


N’ 


Example  2 


For  the  system 


y(t)  + 5y(t)  + 4y(t)  = u(t),0  < t < 1, 


subject  to  the  constraints 

y ( i h ) = jg-  s i n ( i lOh)  ,h  = 0.1,  i = 1,..  ..,10, 

we  have 

* 4 

y (t)  = lA(i,k)e  , ( i - 1 ) h <:  t < ih,i  = 1,...,10, 
k=  1 


where 

(“l’WV  = f-1.-4.!-4)  , 

and  A ( i , k)  are  determined  by  the  set  of  conditions  (26). 

Hence,  the  resultant  optimal  controller  assumes  the  form 
4 at 

u,(t)  = Ear  A(i,k)e  k ,(?-l)h  ^ t < ih,i  = 1 10, 

k=3 

where  { A ( i , k)  : i = 1 , . . . , 10, k = 3,4}  are  given  in  Table  1. 

TABLE  1 

i 1 2 3 4 5 6 789  10 

A(i ,3)  0 -.117  .080  .028  .036  .028  .033  .006  .087  0 

A( i ,4)  0 .022  -.005  .000  .000  .000  .000  .000  -.001  0 


7 . Conclus ion 

A meaningful  relationship  has  been  established  between  a class  of  minimum 
energy  control  problems  and  spline  interpolation.  Even  though  the  results 
presented  here  are  for  finite-time  systems,  they  easily  generalize  to  infinite- 


(31a) 

(31b) 

(32) 

(33) 

(34) 

(35) 


time  systems. 
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